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Abstract — This paper is concerned with general interference 
channels characterized by a sequence of transition (conditional) 
probabilities. We present a general formula for the capacity 
region of the interference channel with two pairs of users. 
The formula shows that the capacity region is the union of 
a family of rectangles, where each rectangle is determined by 
a pair of spectral inf-mutual information rates. Although the 
presented formula is usually difficult to compute, it provides us 
useful insights into the interference channels. For example, the 
formula suggests us that the simplest inner bounds (obtained by 
treating the interference as noise) could be improved by taking 
into account the structure of the interference processes. This is 
verified numerically by computing the mutual information rates 
for Gaussian interference channels with embedded convolutional 
codes. 

I. Introduction 

The interference channel (IC) is a communication model 
with multiple pairs of senders and receivers, in which each 
sender has an independent message intended only for the 
corresponding receiver. This model was first mentioned by 
Shannon Jl]] in 1961 and further studied by Ahlswede J2l 
in 1974. A basic problem for the IC is to determine the 
capacity region, which is currently one of long-standing open 
problems in information theory. Only in some special cases, 
the capacity regions are known, such as strong interference 
channels and deterministic interference channels JlrS]. On 
the other hand, some inner and outer bounds of the capacity 
region are obtained, for example, see flSSl- In recent years, 
Etkin, Tse and Wang [8] introduced the idea of approximation 
to show that Han and Kobayashi region (HK region) ||4j] is 
within one bit of the capacity region for Gaussian interference 
channel (GIFC). 

In list], the authors proposed a new computational model 
for the two-user GIFC, in which one pair of users (called 
primary users) are constrained to use a fixed encoder and 
the other pair of users (called secondary users) are allowed 
to optimize their codes. The maximum rate at which the 
secondary users can communicate reliably without degrading 
the performance of the primary users is called the accessible 
capacity of the secondary users. Since the structure of the 
interference from the primary link has been taken into account 
in the computation, the accessible capacity is usually higher 
than the maximum rate when treating the interference as 
noise, as is consistent with the spirit of lioll llTll . However, 
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Fig. 1. General interference channel W. 

to compute the accessible capacity |9J], the primary link is 
allowed to have a non-neglected error probability. This makes 
the model unattractive when the capacity region is considered. 
For this reason, we will remove the fixed-code constraints 
on the primary users in this paperQ In other words, we will 
compute a pair of transmission rates at which both links can 
be asymptotically error-free. 

To justify the computational results, we consider a more 
general interference channel which is characterized by a 
sequence of transition probabilities W = {VF™}^^. Similar 
to lll2ll . we utilize the information spectrum approach lfl3ll ifbUl . 
The capacity region can be described in terms of the spectral 
inf-mutual information rates. 

The rest of the paper is structured as follows. Sec. [TT] 
introduces the main definitions, including general IC and 
spectral inf-mutual information rate. In Sec. [TTT1 a formula is 
proved for the capacity region of the general IC. In Sec. [IV] 
we present numerical results for GIFC with binary-phase shift- 
keying (BPSK) modulation. Sec. IVl concludes this paper. 

II. Basic Definitions And Problem Statement 

A. General IC 

Let Xi, X 2 be two finite input alphabets and y x , y 2 be two 
finite output alphabets. A general interference channel W (see 
Fig ■ [B is characterized by a sequence W = { W n (• , • | • , • ) } , 
where W n : X™ x X 2 — > y[ l x y 2 is a probability transition 
matrix. That is, for all n, 

I^ n (y 1 ,y 2 |x 1 ,x 2 ) > 
^"(y 1 ,y 2 |x 1 ,x 2 ) = 1. 

'The authors are grateful to Prof. Tse who inspired us to continue the 
research in this direction when our previous work was presented at ISIT'201 1. 



The marginal distributions , W 2 of the W n are given by 

^r( yi |x 1; x 2 ) - Yl W n (y 1 ,y 2 \K 1 ,x 2 ), (1) 

y 2 e:v 2 " 

^ 2 "(y 2 |x 1 ,x 2 ) = W / "(yi,y 2 |xi,x 2 ). (2) 

Definition!: An (n, , , £n \ £n^) code for the 
interference channel W consists of the following essentials, 

a) message sets: 

M.£ ] ={1,2,..., AfW}, for sender 1 
={1,2,..., M^}, for sender 2 

b) sets of codewords: 

{xi(l),xi(2), . . . ,xi(Af^ 1} )} C AT, for encoder 1 
{x 2 (l),x 2 (2), . . . ,x 2 (Af^ 2) )} C X%, for encoder 2 

For sender 1 to transmit message i, encoder 1 outputs 
the codeword Xi(i). Similarly, for sender 2 to transmit 
message i, encoder 2 outputs the codeword x 2 (j). 

c) collections of decoding sets: 

{Bii C y{ l } i=1 M (i), for decoder 1 
{B 2j C y 2 n } j=1 '.' m< 2 ' » for decoder 2 
where B u f| = for i ^ i' and B 2j f| #2/ = for 

After receiving y x , decoder 1 outputs i whenever yi G 
2?^. Similarly, after receiving y 2 , decoder 2 outputs j 
whenever y 2 G B 2 -■ . 

d) probabilities of decoding errors: 



(1) Vf(2) 



-(1) 



,(2) 
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E E WTCBfilxiCO.xaO')) 
t=l j=l 

E E W 2 "(B| i |x 1 (z),x 2 (j)), 



where the superscript "c" denotes the complement of a 
set. Here we have assumed that each message of i e 
A^n 1 ' and j G A^l 2 '' is produced with equal probability. 
Remark: The optimal decoding to minimize the probability 
of errors is defining the decoding sets Bu and B 2 j according 
to the the maximum likelihood decoding rule 111511 . That is, the 
two receivers choose, respectively, 



and 



arg max Pr{yi |xi (i)} 



j = argmaxPr{y 2 |x 2 (j)} 



as the transmitted messages. 

Definition 2: A rate pair (Ri,R 2 ) is achievable if there 
exists a sequence of (n, Mn , M„ , £n , ) codes such that 

lim el 1} = and lim el 2) = 0, 



liminf — - — > R\ and liminf — - — > R 2 . 

n— >oo Tl n— >oc n 



r(2) 



Definition 3: The set of all achievable rates is called the 
capacity region of the interference channel W, which is 
denoted by C(W). 

B. Preliminaries of Information-Spectrum Approach 



The following notions can be found in 11411 . 
Definition 4 (liminf in probability): For a sequence of ran- 
dom variables {Z n }^L 1 , 

p- liminf Z n = sup{/3| lim Pr{Z„ < (3} = 0}. 

n— >oo n— >-oo 

Definition 5: If two random variables sequences Xi = 
{Xf }£° =1 and X 2 = {X" 2 l }^ =l satisfy that 



(xi,x 2 ) = Fx 1 "(xi)Px 2 "(x 2 ) 



(3) 



for all Xi G Af", x 2 G A 2 l and n, they are called independent 
and denoted by Xi_LX 2 . 
Similar to [13], we have 
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Definition 6: Let 5/ = {(Xi, X 2 )|Xi_LX 2 }. Given an 
(Xi,X 2 ) G Si, for the interference channel W, we define 
the spectral inf-mutual information rate by 



KXuYi) e 

I(X 2 ;Y 2 ) e 

where 

fy 1 »|x 1 "(yi|xi) 

■PK»|X?(y2|x 2 ) 



p- lim inf — log 



p- lim inf — log 

n— ¥oo TL 



A? 07) 



(4) 
(5) 



P x? (x 2 )^"(y 1 ,y 2 |x 1 ,x 2 ),(6) 

X2,Y2 

Y, Px»(xi)Ty n (y 1 ,y 2 |x 1 ,x 2 ).(7) 

xi,yi 

III. The Capacity Region of General IC 

In this section, we derive a formula for the capacity region 
C(W) of the general IC. 

Theorem 1: The capacity region C(W) of the interference 
channel W is given by 

C(W) = |J ft w (Xi,X 2 ), (8) 

(Xi,x 3 )eSi 

where 7?-w(Xi,X 2 ) is defined as the collection of all 
(i?i,i? 2 ) satisfying that 

0<i?i < I(X l5 Yi) (9) 

0<i? 2 < I(X 2 ;Y 2 ). (10) 

To prove Theorem Q] we need the following lemmas. 
Lemma 1: Let 

(X 1 ={X?}~ 1 ,X 2 ={XJ}~ 1 ) 

be any channel input such that (Xi,X 2 ) G Si. The 
corresponding output via an interference channel W = 
{W n } is denoted by (Yi = {Yi"}~ =1 ,Y 2 = {Y 2 n }™ =1 ). 
Then, for any fixed Mn and Mn\ there exists an 
(n, , Mi 2) , , ) ) code satisfying that 

4 X) + 4 2) < Pr{T n c (l)} + Pr{T„ c (2)} + 2e~ n \ 



(11) 



where Lemma 2: For all n, any (n, Mn\M„ ,Sn ,Sn^) code 

satisfies that 



r n (i) = { (x 1>yi )|ibg^gc^ > iiogMP + 7 } (1) p^it™ 



T„(2) = {(x 2 , y a )| i log ' ' } > I log + 7 }. (2) i f^OTI*?) i (2) 



^ > Pr{i log ^T:;"T i; < h - 7} 



e 



& > Pr{i log ^ " < i log MA - 7} - e- 



-71-7 



■TI7 



Proof of Lemma [7} The proof is similar to that of [ 1 3 



(13) 

Lemma 3] " for every 7 > 0, where X™ (resp.,^ 1 ) places probability 

Codebook generation. Generate M^ independent code- mass l / M n ) ( res P-> 1 / M n ) ) on each codeword for encoder 

words Xl (l), ...,X!(mP) G *f subject to the probability 1 < res P" encoder 2 > a *_| ©• ©• © hold. 

, . n „. ., , (2) . , ... Proof of Lemma [2^ The proof is similar to that of 11131 

distribution rV». Similarly, generate M„ ' independent code- „ r, . , , . 

1 M-j Lemma 4j. By using the relation 
words X2(l), x 2 (MA ; ) G subject to the probability 

distribution Px S - Py?\x? (yi\xi) _ firgjiyfrijyi) 

Encoding. To send message i, sender 1 sends the codeword Py? (yi) Pxj*(xi) 

xi (i). Similarly, to send message 7, sender 2 sends x 2 (j). and noticing Px „( Xl ) = _4_ we can rewrite the first term 

Decoding. The receiver 1 chooses i such that (x x (i), y x ) G on the right . han d sid e of the first inequality of Q3J as 

T„(l) if such i exists and is unique. Similarly, the receiver 2 

chooses the j such that (x 2 (j),y 2 ) G T n (2) if such j exists Pr{P xp | y n(Xf |y x n ) < e~" 7 }. 

and is unique. Otherwise, an error is declared. gy setting 

Analysis of the error probability. By the symmetry of the 

random code construction, we can assume that (1, 1) was sent. L n = {(xi,yi)|P X n|yn(x 1 |yi) < e ™ 7 }, 

^ e ^ ne the first inequality of ( [T3l can be expressed as 

E U = {(X!(i), yi ) G T n (l)}, P 2j = {(x 2 (i),y 2 ) G T n (l)}, Pr{i„} < + e"" 7 - (14) 

„ , ■£ / h\ \ ^ m ii\ In order to prove this inequality, we set 

For receiver 1, an error occurs if (xi(l),yi) f. T n (l) or r 1 j> 

(xi(i),yi) G T„(l) for some i ^ 1. Similarly, for receiver 2, ^ = { yi e ;yr|P xr |y™(xi(i)|yi) < e~" 7 }. 

an error occurs if (x 2 (l), y 2 ) £ T n {2) or (x 2 (j), Yi) G T„(2) 

for some j 7^ 1. So the ensemble average of the error 

probabilities of decoder 1 and decoder 2 can be upper-bounded , 

as follows: Pr ^"> = g **r?(M*), A) 



It can be seen that 



i=l 

Mi 1 ' M« 



e,^ + ei 2) = £l 1} + el 2) = E Px?Yr(*i (*)> A fl^w) + E ^«y»(xi(i), Afl8f,) 

< Pr^fJ + Pr{ U PiJ + Pr{P 2 c i} + Pr{ U E 2j } 



It can be seen that 



i=i t=i 

Mi 1 ' Mi 1 ' 

< E Px Y Y 1 A^).Af]Bu)+ E ^^(xiW.Bf,) 

i=l i=l 

Pr{ U Sw} < E Pr{£?ii} = E E Px r r«(xi(i), yi ) + 

= EPr{(x 1 (0,yi)GT„(l)} M P . (1) 

<5ti = E E p x? |y» (xi (*) |yi )Py» (yi ) 

= E E Px r (xi)^(yi) i=ly ^ nBli 
6 ^(^.yoe^d) <e- 7 E E 1 - (1 

< E E PxKxOPynixHyilxx)^ <=1 y^Bx 

^l(xi,yi)eT„(l) • Ai " mW 



<e-" 7 E E iV»(yi) + 4 

»=1 yi6£i, 

Jl/i 1 ' 

< E ^ = - 1)^ < e" 117 , = e- ny PYH U BiO + < e"" 7 + 4 13 , 

- "fi Mi 1 ' v ; A/i 1 ' - ' i=\ 



(15) 

where "a" follows from the independence of x x (i) (i ^ 1) where S h is the decoding region corresponding to codeword 
and yi and "6" follows from the definition of T n (l). Similarly, x i(«) and follows from me definition of A- Therefore, 
we obtain m e first inequality of ( TT3l > is proved. Similarly, we can obtain 



Pr{|JP2,}<e-" 7 . (12) 



the second inequality of ( fT3l . 
Now we prove Theorem [T] 



Proof of Theorem Q} 

Combining all inequalities above, we can see that there V To P rove that an arbitrary (Pi,P 2 ) satisfying © and 
must exist at least one (n, , M^ 2) , el^ , e^) code satis- © is achievable, we define 

fying CD. ■ Mi 1 ) = e"( fll " 27 ) and = e < R --^) 
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Fig. 2. Symmetric Gaussian interference channel. 

for an arbitrarily small constant 7 > 0. Then, Lemma Q] 
guarantees the existence of an (n, M„ , M„ , e„\ e^ 2 ') code 
satisfying 

4 1) + £ l 2) <Pr{ilog^™< Jil _ 7} 
+Pr{i log <ifc ~ 7} + 2e-^ 



<Pr{ilog 

+Pr{^ log ^p^S^ < K x 2; Y 2 ) - 7} + 2e— 



iv»(y 3 n ) 

(16) 

From the definition of the spectral inf-mutual information rate, 
we have 

lim = and lim = 0. 

n— too n— >oo 

2) Suppose that a rate pair (Rx, R2) is achievable. Then, for 
any constant 7 > 0, there exists an (n, M„\ M„\ £n\ £« 2 ') 
code satisfying 



logM, 



(i) 



> i?i — 7 and 



log M, 



(2) 



>i? 2 - 7 (17) 



for all sufficiently large n and 

lim 4 1} = and lim = 0. 

n— >oc n— >oo 

From Lemma |2] we get 

> Pr{i log PY %i%\ X " } <Ri- 27} - e-r 
£ 1 2) > Pr{i log Py ^\ { ™ ] <R 2 - 27} - e-T 



(18) 

Taking the limits as n. — > 00 on both sides, we have 

lim Pr{i log ^XligT^ < Ri - M = 
lim Pr{i log ^p^U, < i? 2 - 27} = 

implying by definition that i?i — 27 < 7(Xi; Yi) and R2 — 
27 < Z(X 2 ; Y2). This completes the proof since 7 is arbitrary. 



IV. Numerical Results 

We have obtained a formula of the capacity region for the 
general IC, which shows that any pair of independent input 
processes define a pair of achievable rates. Although it is not 



computable in general, the formula provides us useful insights 
into the interference channels, as illustrated by the following 
example. 

The considered example has the model as shown in Fig. |2] 
where the channel inputs xi (i) and Xa(i) are BPSK sequences 
with power constraints Pi and P2, respectively; the additive 
noise ni and 112 are sequences of independent and identically 
distributed (i.i.d.) Gaussian random variables of variance one; 
the channel outputs yi and y2 are 



yi = xi(i) + Vax 2 (i)+ni, 
y 2 = x 2 (j) + \faxi{i) + n 2 . 



(20) 
(21) 



For any two arbitrary input processes xi and x 2 , the defined 
pair of rates given in Theorem Q] are infeasible to compute. 
Therefore, we assume that xi and x 2 are the outputs from 
two (possibly different) generalized trellis encoders driven by 
independent uniformly distributed (i.u.d.) input sequences, as 
proposed in J9[]. In this case, both xi and x 2 are block-wise 
stationary, and (hence) 

/(X^Yx) = lim ll(X?;Y?), (22) 

n— >oo Tl 

J(X 2 ;Y 2 ) = lim -I(X$;Y 2 n ). (23) 

Since Xi , x 2 and yi , y 2 can be viewed as the Markov chains 
and the hidden Markov chains, respectively, the right-hand 
sides of d22l and d23l can be estimated by performing the 
BCJR algorithm Fl ifl^lfnll . 

We consider two schemes, UnBPSK and CcBPSK, where 
UnBPSK means that xi (resp. x 2 ) is an i.u.d. BPSK sequence 
and CcBPSK means that xi (resp. x 2 ) is an output from the 
convolutional encoder with the generator matrix 



D + D A l + D 2 



(24) 



G(D) = [1 

Fig.[3]shows the trellis representation of the signal model when 
sender 1 uses CcBPSK and sender 2 uses UnBPSK. Fig. [4] 
shows the numerical results. The point "A" can be achieved by 
a coding scheme, in which sender 1 uses a binary linear (coset) 
code concatenated with the convolutional code and sender 2 
uses a binary linear code, and the point "B" can be achieved 
similarly; while the points on the line "AB" can be achieved 
by time-sharing scheme. The point "C" represents the limits 
when the two users use binary linear codes but regard the 
interference as an i.u.d. additive (BPSK) noise. It can be seen 
that knowing the structure of the interference can be used to 
improve potentially the bandwidth-efficiency. 

V. Conclusions 

In this paper, we have proved that the capacity region of 
the two-user interference channel is the union of a family 
of rectangles, each of which is defined by a pair of spectral 
inf-mutual information rates associated with two independent 
input processes. For special cases, the defined pair of rates 
can be computed, which provide us useful insights into the 
interference channels. 

2 Only forward recursion is required. 
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Fig. 3. The trellis section of (CcBPSK, UnBPSK) with 32 branches. For 
each branch b, s~ (b) and s + (fo) are the starting state and the ending state, 
respectively; while the associated labeling xi (b) and X2 (b) are the transmitted 
signals at sender 1 and sender 2, respectively. 
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Fig. 4. The evaluated achievable rate pairs of a specific GIFC, where 
P\ = P2 = 7.0 dB and a = 0.5. UnBPSK means that xi (resp. X2) is an 
i.u.d. BPSK sequence and CcBPSK means that xi (resp. X2) is an output from 
the convolutional encoder with the generator matrix [1 + D + D 2 1 + D 2 ]. 
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